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ABSTRACT : 

PROBLEM TO BE SOLVED: To provide mult i- focus images usable for 
image 

analysis by obtaining the plural images in the same photographing 
range focused 

at successively different image depth, extracting focused partial 
images from 

the respective images and synthesizing the extracted partial images. 

SOLUTION: By the lens driving part 22 of a camera 12, a focus 
position is 

set at the successively different image depth while photographing the 
images . 

The deviation of a center position at a set focus position which is 
the 

intrinsic property of a lens 16 and the data of affine correction by 
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an image 

formation position are prepared beforehand- The driving state of the 
lens 

driving part 22 and the images recorded in a CCD image pickup part 2 0 
are 

transferred to a processing main body part 2 6 in real time, and at 
the time of 

matching the plural focus positions set beforehand, the position data 
and 

partially focused image data are successively recorded. The 
processing main 

body part 26 executes centering correction and the affine correction 
to the 

recorded data, performs layer synthesis and obtains the multi- focus 
images . 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the multi-focus image creation approach and multi- 
focus image listing device which can obtain easily the multi -focus image creation approach which a 
focus suits in all the fields of the photographic coverage made into the purpose and a multi-focus image 
listing device, and the multi-focus image which can be especially used for image analysis etc. 
[0002] 

[Description of the Prior Art] In order to perform inspection of process tolerance and the movement 
property analysis of a migration body of precision processing components etc. from the former, the 
analysis technique which uses an image processing is adopted. For example, in order to inspect process 
tolerance on the interior of a boa inside the engine of an automobile, the front face of a cylinder, etc., a 
part to be examined is photoed first. And the obtained image is analyzed per pixel, magnitude (area) of a 
surface blemish and calculation of the number are performed, and a quality judgment of processing is 
made. 

[0003] By the way, when photoing the front face of components etc., it is necessary to perform macro 
photography. When performing macro photography, depth of field become very narrow. Especially, 
with components with much irregularity, or the components which have a three-dimensional 
configuration, a focus can be doubled with surface [ a part of ] on a front face. Moreover, when 
analyzing the movement property of a migration body, it was difficult to double a good focus with all, 
such as a distant view, an intermediate view, and a close-range view. 

[0004] In such a case, in the former, depth of field were expanded, and a photograph was taken, or it 
coped with [ the large-scale large quantity of light lighting system was utilized, and ] taking a 
photograph by expanding depth of field by long duration exposure etc., and the image which the focus 
suited in the whole analytical range was acquired. 
[0005] 

[Problem(s) to be Solved by the Invention] However, when the depth of field by large-scale large 
quantity of light lighting system which was mentioned above are expanded, a photography object is 
heated and there is a problem that heat deformation is caused or there is a possibility that the quality of 
the material may deteriorate. Moreover, since a focus (focus) shifts in a slight vibration when expanding 
depth of field by long duration exposure, while a setup of a photography environment becomes 
complicated and photography becomes large-scale, it takes time amount. Moreover, prolonged exposure 
has the problem of being inapplicable in photography of a migration body, especially a high-speed 
migration body. 

[0006] In addition, the technique which displays an image both the close-range view and whose distant 
view the focus suits is indicated by JP, 7-3079 1,A as an approach of acquiring a multi-focus image by 
branching the image of a close-range view and a distant view according to optical system, displaying the 
image of a close-range view on the odd number scanning line of a video signal, and displaying the 
image of a distant view on the even number scanning line. However, since it was only forming the 
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multi-focus image visually, it was difficult to perform image analysis per pixel. 

[0007] This invention is made considering solving such a problem as a technical problem, and aims at 

offering the multi-focus image creation approach and multi-focus image listing device which can obtain 

easily the multi-focus image which can be used for image analysis. 

[0008] 

[Means for Solving the Problem] In order to attain the above purposes, the configuration of this 
invention The image acquisition step which acquires two or more images of the same photographic 
coverage which the focus suits with image depth which is the multi-focus image creation approach 
which creates a multi-focus image based on the image acquired with the image photography means, and 
is different, It is characterized by including the extract step which extracts the partial image which the 
focus suits from each acquired image, and the creation step which compounds the extracted partial 
image, re-compounds said photographic coverage, and creates a multi -focus image. 
[0009] Here, image depth is the depth of the depth direction when being based on the location of 
arbitration, and the depth to the photographic subject in distance of arbitration, such as a close-range 
view, an intermediate view, and a distant view, is said. Moreover, the image acquired by the image 
photography means is an image which the focus suits by the part within photographic coverage. 
[0010] Since according to this configuration only the partial image which the focus suits is extracted out 
of two or more acquired images and re-composition of an image is performed, there is no need of 
expanding the depth of field in each focal location, and the need of using the lighting system of the large 
quantity of light, or lengthening the exposure time is lost. And the multi-focus image which the focus 
suits in all the fields of photographic coverage can be obtained. In addition, when using said multi-focus 
image for the processing quality judging of components etc., it is good for analyses, such as a part for a 
background, also as outside of the object of re-composition of an unnecessary part of a multi -focus 
image. 

[001 1] In order to attain the above purposes, the configuration of this invention is characterized by said 
image acquisition step acquiring two or more images which carried out sequential migration of the focal 
location of the lens of an image photography means, and the focus suited with different image depth. 
[0012] Here, regulating automatically or hand regulation which used the motor, the ball screw, etc. is 
sufficient as focal justification of a lens. Moreover, image acquisition timing may be continuous and 
may be intermittently performed in the part of the predetermined image depth set up beforehand. To 
**** and perform image acquisition intermittently, according to the depth of field based on photography 
conditions, it is necessary to set up image acquisition timing (acquisition spacing) so that all the fields of 
the multi-focus image needed by two or more extracted partial images can be covered. 
[0013] According to this configuration, the image of each image depth required for multi-focus image 
composition only at amelioration of a lens part is easily acquirable. When a focal location cannot be 
fixed by the case where there are two or more classes the case where especially the configuration for 
photography is not stabilized, and for photography etc., modification of a focal location is easy and can 
perform photographing work smoothly. 

[0014] the image said image acquisition step carried out incidence to an image photography means 
further in the configuration of this invention in order to attain the above purposes — a spectrum ~ it 
carries out that the acquisition step which acquires the image which a focus suited with the image depth 
which make carry out the image formation of the separation projection step which makes projection in 
the direction of plurality, and each image by which separation projection was carried out on die image 
acquisition means arranged at different optical-path distance, and changes with means is included as the 
description. 

[0015] here - said spectrum - a means is what combined a half mirror and prism, for example, an 
image is projected in the three directions, and an image acquisition means acquires the image which the 
focus suits partially in each location, such as a close-range view, an intermediate view, and a distant 
view, in addition, said spectrum — the spectrum of a means — a number — arbitrary — moreover, a 
spectrum — the distance of a means and an image acquisition means can also be adjusted to arbitration. 
[0016] According to this configuration, the image of each image depth required for multi-focus image 
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composition can be acquired easily, without needing a complicated drive. When the image depth for 
photography is limited especially, the stable image can be obtained with an easy configuration. 
[0017] In order to attain the above purposes, the configuration of this invention is characterized by said 
image acquisition step containing the step which scans the candidate for photography optically, and the 
acquisition step which acquires a scan image to coincidence with two or more image photography means 
which the focus suits with different image depth. 

[0018] Here, as for the candidate for photography, the whole surface side is scanned with a scanner etc. 
According to this configuration, the image of each image depth required for the multi-focus image 
composition for small components etc. is easily acquirable. 

[0019] In order to attain the above purposes, the configuration of this invention is characterized by said 
image acquisition step containing the maintenance step which carries out storage maintenance of the 
image which the focus suited with different image depth. 

[0020] Here, maintenance of an image is performed by a magnetic storage medium, the optical storage, 
etc. According to this configuration, since image collection can be performed in the location of the 
arbitration for photography and a multi-focus image can be compounded separately, without receiving a 
limit of a photography location, photographing work nature improves. 

[0021] In order to attain the above purposes, the configuration of this invention An image acquisition 
means to acquire two or more images of the same photographic coverage which the focus suits with 
image depth which is the multi-focus image listing device which creates a multi-focus image based on 
the image acquired with the image photography means, and is different, A storage means to memorize 
the acquired image, and an extract means to extract the partial image which the focus suits from each 
memorized image, It is characterized by including a synthetic means to compound the extracted partial 
image, to re-compound said photographic coverage, and to create a multi-focus image, and a display 
means to display said multi-focus image at least. 

[0022] The multi -focus image which the focus suits in all the fields of photographic coverage can be 
obtained without becoming unnecessary, and using the lighting system of the large quantity of light, or 
expansion of depth of field lengthening the exposure time, since according to this configuration only the 
partial image which the focus suits is extracted out of two or more acquired images and re-composition 
of an image is performed. 
[0023] 

[Embodiment of the Invention] Hereafter, the gestalt (henceforth an operation gestalt) of suitable 
operation of this invention is explained based on a drawing. The configuration conceptual diagram of the 
multi -focus image listing device (only henceforth a listing device) 10 for realizing the multi -focus image 
creation approach of this operation gestalt is shown in drawing 1 . Said listing device 10 consists of the 
image creation sections (for example, personal computer) 14 which process CCD camera (only 
henceforth a camera) 12 which photos the components which are the candidates for photography, and 
the photoed image. 

[0024] The characteristic matter of this operation gestalt acquires two or more images of the same 
photographic coverage which the focus suits with image depth (for example, a distant view, an 
intermediate view, a close-range view) which is different as shown in drawing 2 , it extracts only the 
partial image which the focus suits out of two or more acquired images, performs re-composition of an 
image, and is just going to obtain a multi-focus image. In addition, in the case of drawing 2 , the part 
which the focus does not suit is omitted. 

[0025] In order to acquire two or more images of the same photographic coverage which the focus suits 
with different image depth in the case of the listing device 10, the camera 12 as an image acquisition 
means contains a lens 16, the body 18 of a camera, the CCD image pick-up section 20, the lens 
mechanical component 22, and the focal control section 24. The control section to which the image 
creation section 14, on the other hand, performs control of said camera 12 and control of the listing- 
device 10 whole, The image extract section which extracts the part which the focus suits out of the 
image which the camera 12 acquired, The extracted image It combines. The image of the original 
photographic coverage The re-composition section (synthetic means), the storage means of an image, 
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etc. of re-compounding It consists of keyboards, mice, etc. for performing the included processing body 
section 26, the display 28 which performs the display of a photography image or a synthetic image, the 
operating procedure of a listing device 10, and the display of the contents of processing, and actuation 
and the compound image restoration of a listing device 10 manually. 

[0026] First, the acquisition' procedure of the image which the focus suits with different image depth is 
explained. In addition, in the case of this operation gestalt, the case where the image depth for 
photography is divided into 3 depth of a distant view, an intermediate view, and a close-range view is 
explained, but by the depth of field in the depth and the photography conditions for photography, said 
number of partitions is arbitrary, for example, may be carried out comparatively 5 ****s for 8 minutes. 
[0027] In the processing body section 26, the focal location for every image depth for photography is set 
up based on the depth of field (it changes with strength of lighting etc.) in the magnitude for 
photography, depth, concave convex voice, and the photography environment at the time of 
photography. In addition, a focal location is set up so that it may overlap [ whether the part which the 
focus suits in this case based on depth of field touches by the distant view, the intermediate view, and 
the close-range view, and ]. The data of the focal location set up in the processing body section 26 are 
supplied to the focal control section 24, and the lens mechanical component 22 (for example, pulse 
motor) drives them to initiation and coincidence of photography for photography. And the focus of a 
lens 16 is moved to a close-range view location (the distant view location from a close-range view 
location may be used) for example, from a distant view location by rotating gear 16a for a lens drive by 
the lens mechanical component 22. At this time, the drive conditions (distance to a focal location etc.) of 
the lens mechanical component 22 are used, when performing the timing recognition of image 
acquisition, the centering amendment of an image, and affine transformation which it is fed back to the 
processing body section 26 on real time, and are later mentioned through the focal control section 24. 
[0028] On the other hand, the image recorded in the CCD image pick-up section 20 through the lens 16 
is transmitted to the processing body section 26 on real time, and the focal location fed back from said 
lens mechanical component 22 is checked, and the processing body section 26 concerned carries out 
record maintenance of the image whose focal location and partial target concerned the focus suits, when 
in agreement with the focal location set up beforehand. 

[0029] Similarly, record maintenance of the image to which the l'ocation of a focus changes from the 
distant view which is partially to the point one by one toward a close-range view is carried out, checking 
that the focus of a lens 16 has suited the focal location of the processing body section 26 set up by the 
lens mechanical component 22. In this case, the processing body section 26 may be made to perform 
image recording, when you may record on an image, a focal location is moved intermittently and a focal 
location is fixed, while the lens mechanical component 22 was moving the focal location continuously. 
In addition, only the number of sheets which asks for the image which the focus suits in the desired 
location can be obtained by performing such image acquisition. 

[0030] Next, the synthesis procedure of a multi -focus image is explained using drawing 1 - drawing 7 . 
Dra wing 3 is an explanatory view explaining the synthesis procedure of a multi -focus image. The 
processing body section 26 will perform centering amendment of an acquisition screen first, if the image 
which the focus suits partially is acquired (SI 00) (SI 01). If focal adjustment is generally performed 
where a camera 12 is fixed with a tripod etc., the location for [ which carries out image formation ] 
photography (for example, core) will shift on the CCD image pick-up section 20 according to the error 
of the optical axis of a lens 16. Therefore, when compounding two or more some images with which 
focal locations differ like this operation gestalt, location gap arises in a synthetic image. Since this 
location gap is the property of the proper for every lens 16, it computes beforehand the movement 
magnitude of above [ corresponding to a focal location ], down, the left, and the right, and creates the 
correspondence table. 

[003 1] An example of the correspondence table showing the relation between a focal location and 
movement magnitude is shown in drawing 4 . If centering amendment is performed according to this 
correspondence table, the core of the image acquired focusing on the coordinate for the image 
processing which recognizes the processing body section 26 can be doubled. As shown in drawing 4 , 
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corresponding to the distance from a lens 16, the number (for example, 1-100) is given to each focal 
location. And the processing body section 26 amends the image pin center,large location corresponding 
to the focal location beforehand set up to the acquired image. For example, if 2 dots of the image are 
moved 3 dots and rightward downward when the image A which the focus suits in the Lenses [ 16- 
10.0m ] location (number 99) is acquired, the core of the image A acquired focusing on the coordinate 
for the image processing which recognizes the processing body section 26 can be doubled. If similarly 7 
dots of the image B concerned are moved 6 dots and rightward downward about the image B which the 
focus suits in the location (number 98) of 9.0m, it can be made in agreement with the coordinate core 
where the processing body section 26 recognizes the core of Image B, i.e., the core of said image A. 
Similarly, centering amendment of the image which the focus suits in each focal location is performed. 
Since centering amendment is performed even when some each image is extracted, respectively and it is 
compounded so that it may mention later, gap stops consequently, arising in a synthetic image. 
[0032] Then, the processing body section 26 performs affine transformation (SI 02). If focal adjustment 
is generally performed where a camera 12 is fixed with a tripod etc., the magnitude for [ which carries 
out image formation on the CCD image pick-up section 20 ] photography will change. That is, the close- 
range view carries out image formation greatly from a distant view by the image which doubled and 
obtained the focus to the image and distant view which doubled and obtained the focus from the same 
location to the close-range view. Therefore, when compounding two or more some images with which 
focal locations differ like this operation gestalt, gap of magnitude arises in a synthetic image. Since it is 
the property of the proper for every lens 16 like [ gap of this magnitude ] said location gap, 
corresponding to the focal location, the reduction percentage on the basis of the focal location of 
arbitration and a dilation ratio are shown and correspondence table ** prepared. 
[0033] An example of the correspondence table of the reduction percentage for every focal location at 
the time of being based on the image with which the focus was doubled by the distant view in drawing 
5 , and the dilation ratio for every focal location at the time of being based on the image with which the 
focus was doubled by the close-range view is shown. If affine transformation is performed according to 
this correspondence table, the magnitude of the image formation in each focal location can be doubled 
with a criteria image (for example, distant view image). Corresponding to the distance from a lens 16, 
the number (for example, 1-100) is given to each focal location like the centering amendment mentioned 
above. And the processing body section 26 performs other contraction or expansion amendments of a 
focal location image on the basis of the criteria focus location setup beforehand. For example, when 
[ when a criteria focus location is set as a distant view (number 100) next ] the image A which the focus 
suits in the Lenses [ 16-10.0m ] location (number 99) is acquired, the image is reduced to 99.95%. Next, 
when the image B which the focus suits in the location (number 98) of 9.0m is acquired, it reduces to 
99.91%. Moreover, when [ when a criteria focus location is used as the image whose close-range view 
(number 1) the focus suits next ] the image C which the focus suits in the Lenses [ 16-0. 32m ] location 
(number 2) is acquired, the image is expanded to 100.95%. When similarly the image D which the focus 
suits in the location (number 3) of 0.33m is acquired, it expands to 100.83%. Consequently, since the 
magnitude of each extract image is in agreement with a criteria image even when some each image is 
extracted, respectively and it is compounded so that it may mention later, gap of magnitude does not 
arise in a synthetic image. 

[0034] In addition, although the example mentioned above explained using the image of the number 
which continued like numbers 100, 99, and 98, spacing may be set to arbitration like numbers 100 and 
87 and 33 grades. Moreover, the target image number of sheets may be increased if needed [, such as 
two sheets, five sheets, eight sheets, and 24 etc. sheets, ] according to depth of field, without being 
limited to three sheets, centering amendment and affine transformation ~ the gap at the time of 
composition can be certainly eliminated by using the correspondence table which in any case the 
correspondence table was prepared for every lens and matched the lens since the amount of proofreading 
corresponded according to the property of a lens 16. In addition, the operation expression for 
proofreading may be created and amended for every lens instead of the correspondence table mentioned 
above. 
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[0035] Then, a focus agreement judgment which part of the processing body section 26 the focus (focus) 
suits to the image which centering amendment and affine transformation completed is made (SI 03). 
Generally, it is known for the boundary line of the part which the focus suits, and the part which is not 
correct that the difference of the brightness of an image will change remarkably. For example, if its 
attention is paid to 1 -pixel Rhine of arbitration when the focus suits only the round-head graphic form 
like the graphic form a-1 shown in drawing 6 (a), change of big brightness will occur on the boundary 
line of a focus like the brightness graph b-1 shown in drawing 6 (b). Similarly, also in a graphic form a- 
2 and a graphic form a-3, change of the big brightness on the boundary line of the brightness graph b-2, 
the star map form which the focus suits as shown in b-3, and a square graphic form occurs. That is, if the 
remarkable part of this brightness change is extracted, the partial graphic form which the focus suited 
can be extracted. And if layer composition is carried out combining the partial image of only the 
remarkable part of brightness change as shown in the brightness graph b-4 (SI 04), and a synthetic image 
is created, a multi-focus image as shown in a graphic form a-4 can be obtained. 

[0036] Here, the two concrete approaches of the image extract based on brightness change are explained 
using drawin g 7 and drawing 8 . Drawing 7 is an explanatory view explaining of which image pixel data 
are adopted as data for multi -focus images paying attention to 1 -pixel Rhine of the same part to the 
image A which the focus suits by the close-range view, and the image B which the focus suits by the 
intermediate view. First, a close-range view extracts said 1 -pixel Rhine A-1 and 1 -pixel Rhine B-1 of the 
same part in the image B which the focus suits by 1 -pixel Rhine A-1 of the arbitration of the image A 
which the focus suits, and the intermediate view (however, 1 -pixel Rhine consists of 1280 dots, and the 
part is shown in 1 -pixel Rhine A-1 of drawing 7 , and B-1). and the brightness comparison of the pixel 
which adjoins in 1 -pixel Rhine A-1 -- carrying out -- brightness -- difference A-2 is created, the 
brightness comparison of the pixel which adjoins about 1 -pixel Rhine B-1 similarly -- carrying out -- 
brightness - difference B-2 is created, then, brightness - difference A-2 and the location where B-2 
corresponds are compared, brightness - difference A-2 and B-2 » setting - difference ~ it is the larger 
one as a result of a comparison of what gave the round head to the value, and the result of this 
comparison - brightness ~ brightness data with larger difference are adopted as synthetic Rhine data M- 
1 of a multi-focus image. In the example of drawing 7 , although adoption brightness data have 2 
adjoining dots which is a comparing agency, they shall adopt right-hand side brightness data among 
adjoining dots in this operation gestalt. Moreover, in the synthetic Rhine data M-l, it is brightness data 
of Image B which gave the round head to the brightness value. Consequently, only the brightness data of 
the intense part of brightness change are extracted. That is, only the part which the focus suits will be 
extracted, if such a comparison extract is performed to the screen whole region (the case where a multi- 
focus image is used for some components by a flaw detection etc. « a required part - good), the multi- 
focus image which the focus suits about the whole image can be obtained. 

[0037] Drawing 8 is an explanatory view explaining creation of the synthetic Rhine data M-2 based on 
other comparison approaches. In the example of drawing 7 , adoption brightness data have a possibility 
that it becomes large, and shakiness of the image compounded since it had chosen for every dot may see 
visually, and may become a hot image, then - the comparison approach of drawing 8 « every image - 
brightness ~ when the brightness accumulating totals of difference are computed and the brightness 
accumulating totals exceed the threshold (for example, 40) of arbitration, the comparison between each 
image is performed and it considers as adoption brightness data by making brightness data with larger 
brightness accumulating totals into one group, the brightness corresponding to [ specifically extract 1 
pixel Rhine A-1 of the same part, and B-1 to the image A which the focus suits by the close-range view 
like the example of drawing 7 , and the image B which the focus suits by the intermediate view, and ] it - 
- difference A-2 and B-2 are computed, then, brightness -- from difference A-2 and the same location of 
B-2 - respectively ~ brightness » brightness a total of A-3 and B-3 are computed by totaling difference, 
the case of drawing 8 ~ the brightness from the same location -- difference A-2 and brightness -- if the 
accumulating totals of difference B-2 are computed -- brightness - when four difference A-2 is 
accumulated, a threshold amounts to 40. this time - brightness - the accumulating totals of difference 
B-2 are 30. therefore, four brightness of Image A - the brightness data of the image A corresponding to 
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it are adopted as synthetic Rhine data M-2 of a multi-focus image by making difference into one group, 
the same ~ brightness — the accumulating-totals comparison at the time of the cumulative value of 
difference exceeding a threshold is performed, and adoption brightness data are determined. In addition, 
in brightness a total of A-3 and B-3, what gave the round head to the cumulative value shows that it is 
the larger one of accumulating totals, and is brightness data of the thing image B which gave the round 
head to the brightness value in the synthetic Rhine data M-2. Hereafter, if a comparison extract is 
similarly performed to the screen whole region, the multi-focus image which the focus suits about the 
whole image can be obtained. Thus, by determining adoption brightness data per group, brightness 
change of a synthetic image becomes smooth and a soft and legible synthetic image can be obtained. 
[0038] In addition, although explanation of drawing 7 and drawing 8 explained the example which 
performs image composition based on the image of two sheets [ for the image of two sheets the close- 
range view and whose intermediate view the focus suits ], in a certain case, three or more comparisons 
will be performed for the image of a different focal location between three sheets, ten etc. sheets, etc. at 
coincidence, and the synthetic Rhine data will be created. 

[0039] Although the listing device 10 of drawing 1 explained the structure which acquires two or more 
images which the focus suits with different image depth by the lens mechanical component 22, it 
explains to drawing 9 and drawing 10 the example which acquires two or more images which the focus 
suits with image depth which is different with other structures. 

[0040] Also in the listing device 30 shown in drawing 9 , it consists of a camera 12 and the image 
creation section 14, and processing of two or more images which the focus suits with different image 
depth acquired with the camera 12 is performed like the listing device 10 mentioned above. However, 
the acquisition approaches of two or more images differ. 

[0041] Inside the body 18 of a camera shown in drawing 9 , ****** 32 which consists of a half mirror 
and prism and branches the incident light from a lens 16 in the direction of plurality (in the case of the 
example of drawing 9 three directions) is arranged, and the CCD image pick-up sections 20a, 20b, and 
20c are arranged in the direction of an optical axis which branches by this ****** 32, respectively. In 
the case of the example of drawing 9 , CCD image pick-up section 20a forms the optical system of 
distance which object for close-range views and CCD image pick-up section 20b is arranged in a 
location which object for intermediate views and CCD image pick-up section 20c is an object for distant 
views, and is different from said ****** 32, and is different. Therefore, it can obtain by carrying out 
incidence of the image which the focus suited partially in each CCD image pick-up sections 20a, 20b, 
and 20c once from a lens 16. Therefore, image acquisition time amount can be shortened compared with 
the listing device 10 shown in drawing 1 . 

[0042] In addition, in the example of drawing 9 , with the drive which used the motor and the ball screw, 
the arrangement location of each CCD image pick-up sections 20a, 20b, and 20c can be changed into 
arbitration by automatic control or manual control, and can choose a focal location as arbitration, 
moreover — although the example of drawing 9 explained the example which carries out a spectrum in 
the three directions « a spectrum ~ the number is arbitrary and can acquire a 2-way and at least three 
directions or more of same effectiveness. Since there is no migration of a focus during photography in 
the case of the example of drawing 9 , when the image depth for photography is limited, the stable 
image can be obtained with an easy configuration. 

[0043] The listing device 34 shown in drawing 10 is structure which acquires two or more images which 
the focus suits with different image depth using scanner equipment 36. The reflecting plate 44 grade 
which leads the light reflected luminescence equipment 38 and for [ which have been arranged on 
transparent glass 40 / 42 ] photography to two or more cameras 12 (the example of drawing 10 four 
Cameras [ 12a-12d ] sets) arranged at the scan section 37 concerned is contained in the scan section 37 
of the scanner equipment 36 interior. In the case of a listing device 34, sequential scanning of the 
candidate 42 for photography was carried out, and the scanning image at that time is acquired with two 
or more cameras 12a-12d. The lens focus is beforehand set up so that each cameras 12a-12d can acquire 
the image of a focal location different, respectively. Therefore, the image which the focus suits with the 
image depth which changes with one scans is acquirable. According to this listing device 34, especially, 
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the image inside the crevice of small components can be photoed from an open end side, and the image 
of each image depth required for multi-focus image composition can be acquired easily. In addition, 
although it needs to be beforehand set up according to depth of field etc., a said cameras [ 12a-12d ] 
focal location performs a PURISU can at a time, it checks each focal location for photography, sets up 
an each cameras [ 12a-12d ] focal location, and may be made to perform a formal scan at the 2nd times. 
If these focal justification is performed based on the control by the side of the processing body section 
26, the image of each image depth for obtaining a good multi-focus image is easily acquirable to the 
candidate for photography of various configurations. 

[0044] In addition, although the number of a camera is arbitrary although the example of drawing 10 
explains the example which has arranged four cameras, and you may fluctuate if needed, more than one 
are prepared beforehand, if drive control only of the required camera is carried out to each camera, it 
will become possible to choose image acquisition number of sheets as arbitration, and the versatility of 
equipment will improve. Moreover, once acquiring the image of a distant view and ****** with the 
scan of an eye, focal adjustment of a camera is performed and you may make it acquire the image of an 
inside close-range view and a close -range view with the 2nd scan. By performing such a scan, the image 
of two or more image depth is easily acquirable with a small number of camera. Moreover, the same 
effectiveness can be acquired even if it uses a CCD sensor instead of the camera built in the scan section 
37. 

[0045] In addition, in each listing devices 10, 30, and 34 mentioned above, since image collection for 
photography can be performed and a multi-focus image can be compounded separately, without 
receiving a limit of a photography location since the image processing of a photography location and a 
multi-focus image can be performed in a separate location, if the image data acquired by the camera or 
the CCD sensor is temporarily memorized to a magnetic storage medium, an optical storage, etc., 
photographing work nature can be raised. 
[0046] 

[Effect of the Invention] The multi-focus image which the focus suits in all the fields of photographic 
coverage can be obtained without using the lighting system of the large quantity of light, or lengthening 
the exposure time, since according to this invention only the partial image which the focus suits is 
extracted out of two or more acquired images and re-composition of an image is performed. 



[Translation done.] 
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